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■  This  briefing  focuses  on  the  challenges  of 
performing  integrated  analyses  across  the 
traditionally  ‘stove-piped’  analytic 
environments  of  systems  engineering/ 
engineering  design,  system  performance 
modeling,  and  system  cost  estimation 
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Discussion  Topics 
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Background 

Historical  Analytic  Shortcomings 
Modeling  Environment 

-  Cross-domain  mapping  dilemma 

-  Integrated  Modeling  Workflow 

Effects  of  Integrated  Analyses 

-  Performance  and  Capability-based  Costing 
Challenges 

-  Potential  Approach 

-  Why  LCC  /  Hour? 

-  Cost  Estimation  Data  Flow 

-  Calculating  Cost  of  Capability 

-  Other  Challenges 
Lessons  Learned  /  Insights 
Questions 
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Background 


■  Recent  Summit  Engineering  Group  projects  focused  on 
creating  integrated  analytic  frameworks  that  utilize  applicable 
cost,  performance,  and  engineering  models 

-  Office  of  the  Deputy  Assistant  to  the  Secretary  of  the  Army  -  Cost  and 
Economic  Analysis  (ODASA-CE)  Integrated  Performance  and  Cost  Model 
(IPCM)  Program 

-  Naval  Air  Systems  Command  (NAVAIR)  Decision  Support  System  (DSS) 

■  Significant  challenges  to  this  approach 

-  Establishing  communications  between  design  engineers,  performance 
modelers,  and  cost  analysts  throughout  program  life  cycle 

-  Conceptual/Theoretical  differences  between  Performance-based  and 
Capability-based  costing 

-  Often  the  classified  performance  data  is  housed  in  a  different  environment 
than  the  typically  unclassified  cost  data 

■  Ultimate  goal  is  to  provide  decision  makers  and  stakeholders 
with  better  information,  earlier  in  acquisition  cycle 
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Historical  Anaiytic  Shortcomings 

»  » 

■  Cost  and  performance  analyses  are  ‘stove-piped’  and 
often  disjointed 

■  System-level  cost-performance  trades  sometime 
happen  too  late  to  implement  (if  they  happen  at  all) 

■  Collaborative  studies  are  time-consuming  and  usually 
only  bilateral  (involve  only  two  modeling  perspectives) 

-  Cost/Engineering  trades 

-  Engineering/Performance  trades 

-  Engineering  is  link  for  cost/performance  trade  studies 

■  Cost  analyses  (POEs,  ICEs,  CAIG  estimates)  are  often 
not  100%  correlated  with  system  configuration(s) 
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Modeling  Environment 
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Cross-Domain  Mapping  Dilemma 

»  » 


■  Engineering  data  feeds  engineering  models  and 
generates  Outputs 

■  Outputs  serve  as  inputs  to  Performance  model(s) 

■  Cost  model  utilizes  engineering  data/system 
configuration  to  generate  costs 
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Integrated  Modeling  Workflow 
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Effects  of  Integrated  Analyses 

»  » 

■  Focus  discussion  on  feasibility  and  merits  of 
Performance-based  and  Capability-based  Costing  versus 
current  Engineering/Design-based  Costing 

■  Rigidity  of  legacy  cost  and  campaign  models  may  not 
support  Performance  and  Capability-based  Costing 
paradigm 

-  Need  to  invest  in  intellectual  capital  to  leverage  models  currently 
in  use 

-  Need  to  invest  in  new  data  and  new  models 

■  Facilitates  transition  of  analyst  perspective  from  single¬ 
theater,  single-conflict  to  global  force  structure 
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Performance  and  Capability-based 
Costing  Challenges 

■  Different  than  the  traditional  idea  of  “system  cost” 

■  Creates  a  need  for  new  CERs  that  are  more 
aligned  with  mission/campaign  model  inputs 
-  Kills/hr,  area  coverage,  etc. 

■  Reasonableness  and  traceability  of  cost  data 
becomes  a  real  requirement 
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Potential  Approach 

■  Given  “ground  truth”,  can  calculate  level  of 
effectiveness 

-  For  example,  percent  of  targets  detected 

■  Given  specified  fixed-level  of  effectiveness  (goal), 
time  to  achieve  a  common  level  will  vary  by 
alternative 

■  Use  time  to  quantify  both  cost  and  effectiveness 

-  LCC  per  hour  x  hours  to  achieve  desired  level  of 
effectiveness 
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Why  LCC  /  Hour? _ 

■  LCC  /  Hour  captures  not  only  O&S,  but  also  all 
related  R&D/Acquisition/Construction 
investments  required  to  reaiize  the  capability  of 
interest 

■  Some  appiicabie  LCC  /  Hour  adjustments 
-Vignette  attrition 

-Weapon  expenditures 
-Multi-mission  platforms 
-Global  services 

■  Evens  “playing  fieid”  between  legacy  and  new 
systems 
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Cost  Estimation  Data  Flow 


♦ 


♦ 


LCC  Data  Sources 
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I  PROCURE 
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System  N  -  Capability  X 
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Procurement:  Tj  &  Slope 
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26 

$  118 
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•  Same  as  package  #6 
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Q 

•  SIGINT,  MTI  Sensors 
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8  6  048 
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•  Same  as  Package  #8 

•  Same  as  Package  #8 

Component  N 

System  1 
System  2 

Cap  1 

Cap  2 

X 

X 

Total 

Architecture  N 

i 

Cap  1 
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Calculating  Cost  of  Capability 

■  Develop  System  LCC  estimate 

-  R&D  (Actuals  for  legacy  systems  and  some  new  systems) 

-  Acquisition/Construction  (Actuals  for  legacy  systems) 

-  O&S  (Historical  for  legacy  systems) 

■  Convert  all  LCC  estimates  to  common  $  basis 

■  Calculate  LCC/hr  for  each  platform/system  as 
configured 

■  Apply  LCC/hr  for  length  of  time  each  platform/system 
plays  (multiplier) 

LCC/hr  =  LCC  /  (#  units  *  annual  operating  hrs  *  assumed  lifetime) 
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other  Challenges 

«  ♦ 


Analytic  Issue 

Example  Decisions 

Cost  Characteristics 

New  System(s) 

•  New/Niche  capability 

•  Redundant  capability  @ 
lower  cost 

•  Introduce  Automation 

•  iil-defined  technicai 
baseiine 

•  High  uncertainty 

Mods  to  Existing 
System(s) 

•  Add  new  capability 

•  Improve  capability 

•  Focused  impacts 

•  Lower  uncertainty 

Eiiminate 

System(s) 

•  Phasing  out  capability 
provider 

•  Exchange  cost  stream 
with  new  system(s) 

•  Focused  impacts  (vs. 
entire  estimate) 

•  Poiiticai  Issues 
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Lessons  Learned  /  Insights 
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Engineering  Models 

-  Not  built  for  collaboration 

-  May  require  significant  simplifying  assumptions 

Models  are  currently  designed  to  be  used  within  current  stove-piped 
analytic  process 

-  Adapting  models  for  integration  may  require  invasive  changes  to  model 

-  Proliferation  of  integration  environments  may  lead  to  culture  changes 
resulting  in  models  that  are  less  closed  and  stove-piped 

Integrated  modeling  is  more  about  analysis  than  about  integration 

Cultural  roadblocks  threaten  collaboration 

-  Too  much  reliance  on  SMEs 

-  Data  sharing  issues 

-  Lack  of  early  communication 
Classification  issues  must  be  addressed  ASAP 
Benefits  of  integrated  modeling  environments 

-  Can  help  break  stove-pipes 

-  Get  engineers  involved  early  in  decision  process 

-  Help  provide  requirements  traceability 

-  Enable  analysts  to  “see”  the  whole  trade  space 

-  Encourage  development  of  CERs 


♦ 


G  -  R  '  O  -  U  *  P 


Approved  for  public  release 


17 


Questions? 

«  ♦ 
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